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A method and system for providing seamless interoperability and integration between a plurality of devices in a network using a 
common protocol, wherein at least one of the devices is a legacy device which communicates with the network using a proprietary protocol. 
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proprietary protocol to a set of basic commands from the common protocol. A control module is generated for the legacy device, wherein 
the control module is based upon the set of basic commands. The set of basic capabilities of the legacy device are then accessed via the 
control module, thereby providing seamless interoperability and integration of the legacy device with the plurality of devices. 



<WO 9935856A2J_> 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


uz 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


Cote d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






CU 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







BNSDOCID: <WO 9935856A2_I_> 



WO 99/35856 



PCT/US98/26166 



AN AUDIO VIDEO NETWORK 

FIELD OF THE INVENTION 

The field of the present invention pertains to audio- 
video systems. More particularly, the present invention 
5 pertains to the networking of a number of electronic devices 
to form an audio video system. In one embodiment the present 
invention discloses a home audio video network with device 
control modules for incorporating legacy devices. 

10 BACKGROUND OF THE INVENTION 

A typical home audiovisual equipment set up includes a 
number of components. For example, a radio receiver, a CD 
player, a pair of speakers, a television, a VCR, a tape 
deck, and alike. Each of these components are connected to 

15 each other via a set of wires. One component is usually the 
central component of the home audiovisual system. This is 
usually the radio receiver, or the tuner. The tuner has a 
number of specific inputs for coupling the other components. 
The tuner has a corresponding number of control buttons or 

20 control switches which provide a limited degree of 

controllability and interoperability for the components. 
The control buttons and control switches are usually located 
on the front of the tuner. In many cases, some, or all, of 
these buttons and switches are duplicated on a hand held 

25 remote control unit. A user controls the home audiovisual 

system by manipulating the buttons and switches on the front 
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of the tuner, or alternatively, manipulating buttons on the hand held 
remote control unit. 



This conventional home audiovisual system paradigm has become 
5 quite popular. As consumer electronic devices become more capable and 
more complex, the demand for the latest and most capable devices has 
increased. As new devices emerge and become popular, the devices are 
purchased by consumers and "plugged" into their home audiovisual 
systems. Generally, the latest and most sophisticated of these devices are 

10 quite expensive (e.g., digital audio tape recorders, DVD players, digital 
camcorders, and alike). As a consumer purchases new devices, most 
often, the new device is simply plugged Into the system alongside the pre- 
existing, older devices (e.g., cassette tape deck, CD player, and the like). 
The new device is plugged into an open input on the back of the tuner, or 

15 some other device couple to the timer. The consumer (e.g., the user) 

controls the new device via the control buttons on the tuner, via the control 
buttons and control switches on the front of the new device itself, or via an 
entirely new, separate, respective remote control unit for the new device. 

20 As the number of new consumer electronics devices for the home 

audiovisual system have grown and as the sophistication and capabilities of 
these devices have increased, a number of problems with the conventional 
paradigm have emerged. One such problem is incompatibility between 
devices in the home audiovisual system. Consumer electronic devices from 

25 one manufacturer often couple to an audiovisual system in a different 

manner than similar devices from another manufacturer. For example, a 
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tuner made by one manufacturer may not properly couple with a television 
made by another manufacturer. 



In addition, were one device is much newer than another device 
5 additional incompatibilities may exist. For example, a new device might 
incorporate hardware (e.g., specific inputs and outputs) which enables 
more sophisticated remote control functions. This hardware may be 
unusable with older devices within the system. Or, for example, older 
tuners may lack suitable inputs for some newer devices (e.g., mini-disc 
10 players, VCRs, etc.), or may lack enough inputs for all devices of the 
system. 

Another problem is the lack of functional support for differing 
devices within an audiovisual system. For example, even though a 
15 television may support advanced sound formats (e.g., surround sound, 
stereo, etc.), if an older less capable timer does not support such 
functionality, the benefits of the advanced sound formats can be lost. 

Another problem is the proliferation of controls for the new and 
20 differing devices within the home audiovisual system. For example, 
similar devices from different manufacturers can each have different 
control buttons and control switch formats for accomplishing similar tasks 
(e.g., setting the clock on a VCR, programming a VCR record a later 
program, and alike). In addition, each new device coupled to the 
25 audiovisual system often leads to another dedicated remote control unit for 
the user to keep track of and learn to operate. 

3 
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While the emergence of networking and interface technology (e.g., 
IEEE 1394 serial communication bus and the wide spread adoption of 
digital systems) offers prospects for correcting these problems, there is still 
no coherent, open, extensible architecture which can provide for intelligent, 
5 self configuring, easily extensible devices or AV systems. For example, 
while various solutions involving the use of IEEE 1394 as the basis of an AV 
system, none provide for the extensibility of the AV system over its life time, 
as new devices are added whose capabilities and features are unknown. 
None of .hese systems guarantee that all devices can be communicated with 
10 and controlled and enjoyed by the user. 
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SUMMARY OF THE INVENTION 

Accordingly, what is required is a new architecture for a home 
audiovisual system which corrects the interoperability and functionality 
problems of the conventional system. What is required is a new 
5 architecture for an open, interoperating, audiovisual system for devices 
within a home network. What is required is an architecture which allows 
devices from any manufacturer to function seamlessly with a home 
audiovisual system. What is required is an architecture which is 
extensible, and can be readily modified and advanced as market 
10 requirements and technology change. 

The present invention provides a home audio visual (AV) network 
which defines an open architecture for inter-operating CE (consumer 
electronic) devices in a home network. The interoperability aspects of the 

15 present invention define an architectural model that allows CE devices 

from any manufacturer to inter-operate and function seamlessly within the 
user's home AV system. The system of the present invention includes a 
combination of a base set of generic device controls with an method to 
extend a base control protocol as new features and new CE devices are 

20 deployed within the home AV network. In so doing, the architecture of the 
present invention is extensible, and can be readily modified and advanced 
as market requirements and technology change. 

To implement the above features, the present invention includes an 
25 architecture that allows the newly coupled device to be queried. Using the 
results of the query, a software based abstraction of that device is generated 
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and made available to other elements in the network. The software 
abstraction is referred to as a device control module. The device control 
module provides a predefined, standardized, set of interoperability, 
functionality, and control interfaces for the device. The CE device is 
5 coupled to and communicates with the home AV network via a device 
control module. Each CE device in the home AV system has a 
corresponding device control module (DCM). The DCM of the present 
invention also provides an application programming interface (API) to 
allow other applications to access and manipulate any newly coupled CE 
10 device. 

Through the DCMs of the present invention, over the life time of the 
AV system, as new devices are added whose capabilities and features are 
unknown, or only partially known to other devices, a mechanism is 
15 provided which guarantees that all devices can be communicated with and 
controlled at some basic minimal level, and then where possible, as more 
information is obtained about the device, a better abstraction of the new 
device is created. 

20 Because it is likely that some devices that will be available in the 

consumers home were built and sold before the creation of a common home 
network architecture, it is necessary that the architecture is capable of 
recognizing using these devices. These devices are referred to as legacy 
devices and they are generally analog devices controlled through 

25 proprietary control protocols. 
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To allow the architecture of the present invention to provide some 
level of control for these devices the architecture uses the proprietary 
communications path to query the device and discover its basic capabilities. 
The architecture then creates a level 1 DCM for this class of device, 
5 however, this level 1 DCM is special in that it is capable of mapping a 
generic device control command, such as play, to the specific legacy 
command protocol that the device uses. In some cases no such mapping 
will be available. 

10 Specifically, in one embodiment of the present invention, when a 

legacy device is coupled to the network, one of the plurality of devices on the 
network queries the legacy device via the proprietary protocol to determine a 
set of basic capabilities supported by the legacy device. The set of basic 
capabilities are then mapped from the proprietary protocol to a set of basic 

15 commands from the common protocol. A level 1 DCM is then generated for 
the legacy device, wherein the DCM is based upon the set of basic 
commands. The set of basic capabilites of the legacy device are then 
accessed via the level 1 DCM, thereby providing seamless interoperability 
and integration of the legacy device with the plurality of devices. Using this 

20 mechanism, the base architectural model of generic, level 1 DCMs can be 
extended to deal with legacy devices that were built before the creation of the 
architecture of the present invention. In so doing, the present invention 
provides an extremely flexible mechanism that ensures that not only will 
new devices become part of the AV system, but that older devices will 

25 remain useful also. 
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BRIEF DESCRIPTI ON OF THE DRAWINGS 

The present invention is illustrated by way of example and not by way 
of limitation, in the figures of the accompanying drawings and in which 
like reference numerals refer to similar elements and in which: 

5 

Figure 1A shows a home AV network in accordance with one 
embodiment of the present invention. 

Figure IB illustrates a logical bus configuration of the HAVI network 
10 of Figure 1A. 

Figure 2, shows an exemplary peer to peer, two LAV (intermediate 
audio video) node network in accordance with one embodiment of the 
present invention. 

15 

Figure 3 shows a single FAV (full audio video) cluster HAVI network 
in accordance with one embodiment of the present invention. 

Figure 4 shows an FAV cluster integrated with an IAV peer to peer 
20 HAVI network. 

Figure 5 shows an exemplary HAVI network having multiple FAVs. 

Figure 6 shows a diagram of a set top box in accordance with one 
25 embodiment of the present invention. 
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Figure 7 shows a logical block diagram of one embodiment of the 
HAVI architecture of the present invention. 

Figure 8 shows a layered logic diagram of one HAVI architecture in 
5 accordance with the present invention. 

Figure 9 shows a diagram of local and remote messaging in the 
HAVI architecture of one embodiment. 

10 Figure 10 shows a diagram of a message being sent via 1394 in the 

HAVI architecture of one embodiment. 

Figure 11 shows a diagram of an application invoking another 
application in one embodiment of the HAVI architecture. 

15 

Figure 12A shows a first exemplary UI display (e.g., on a television 
screen) for a device (e.g., the camcorder). 

Figure 12B shows a second exemplary UI display (e.g., on a television 
20 screen) for a device(e.g., the camcorder). 

Figure 13 shows a flow chart of a process for providing seamless 
interoperability and integration of a plurality of devices in a HAVI network 
by using the SDD information stored in each device in accordance with one 
25 embodiment of the present invention. 
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Figure 14 shows a flow chart of a process for providing a basic 
command functionality and an expanded command functionality between a 
plurality of devices in a HAVI network in accordance with one embodiment 
of the present invention. 

5 

Figure 15 shows a flow chart of a process for ensuring future 
upgradability and expandability of devices in HAVI network s accordance 
with one embodiment of the present invention. 

10 Figure 16 shows a flow chart of a process for providing seamless 

interoperability and integration of legacy devices with the HAVI compliant 
devices in a HAVI network in accordance with one embodiment of the 
present invention. 

15 Figure 17A shows a flow chart of a process for controlling devices 

within a home audio/video network using an application program from an 
external service provider accordance with one embodiment of the present 
invention. 

20 Figure 17B shows a diagram of a HAVI network with the service 

provider in accordance with the process of Figure 17A. 
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DETAILED DESCRIPTION OF THE INVENTION 

Reference will now be made in detail to the embodiments of the 
invention, examples of which are illustrated in the accompanying 
drawings. While the invention will be described in conjunction with the 
preferred embodiments, it will be understood that they are not intended to 
limit the invention to these embodiments. On the contrary, the invention is 
intended to cover alternatives, modifications and equivalents, which may be 
included within the spirit and scope of the invention as defined by the 
appended claims. Furthermore, in the following detailed description of the 
present invention, numerous specific details are set forth in order to 
provide a thorough understanding of the present invention. However, it 
will be obvious to one of ordinary skill in the art that the present invention 
may be practiced without these specific details. In other instances, well 
known methods, procedures, components, and circuits have not been 
described in detail as not to unnecessarily obscure aspects of the present 
invention. 

The present invention provides a home AV network which defines an 
open architecture for inter-operating CE devices in a home network. The 
interoperability aspects of the present invention define an architectural 
model that allows CE devices from any manufacturer to inter-operate and 
function seamlessly within the user's home AV system. The system of the 
present invention includes a combination of a base set of generic device 
controls with an method to extend a base control protocol as new features 
and new CE devices are deployed within the home AV network. In so 
doing, the architecture of the present invention is extensible, and can be 



11 



WO P9/35856 PCT/US98/26 1 66 

readily modified and advanced as market requirements and technology 
change. The present invention and its benefits are further described below. 



NOTATION AND NOMENCLATI JRR 

Some portions of the detailed descriptions which follow are presented 
in terms of procedures, steps, logic blocks, processing, and other symbolic 
representations of operations on data bits within a computer memory (see 
Figure 2). These descriptions and representations are the means used by 
those skilled in the data processing arts to most effectively convey the 
substance of their work to others skilled in the art. A procedure, computer 
executed step, logic block, process, etc., is here, and generally, conceived to 
be a self-consistent sequence of steps or instructions leading to a desired 
result. The steps are those requiring physical manipulations of physical 
quantities. Usually, though not necessarily, these quantities take the form 
of electrical or magnetic signals capable of being stored, transferred, 
combined, compared, and otherwise manipulated in a computer system. It 
has proven convenient at times, principally for reasons of common usage, 
to refer to these signals as bits, values, elements, symbols, characters, 
terms, numbers, or the like. 

It should be borne in mind, however, that all of these and similar 
terms are to be associated with the appropriate physical quantities and are 
merely convenient labels applied to these quantities. Unless specifically 
stated otherwise as apparent from the following discussions, it is 
appreciated that throughout the present invention, discussions utilizing 
terms such as "processing" or "computing" or "translating" or 
"instantiating" or "determining" or "displaying" or "recognizing" or the 
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like, refer to the action and processes of a computer system, or similar 
electronic computing device, that manipulates and transforms data 
represented as physical (electronic) quantities within the computer 
system's registers and memories into other data similarly represented 
5 physical quantities within the computer system memories or registers 
other such information storage, transmission or display devices. 
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or 



are: 



ARCHTTTCPTTT^T? OVERVIEW 

The Architecture of the present invention enables the creation of a 
Home AV system which provides for seamless support of new devices and 
problem free interoperability of devices in a home AV network. The most 
basic components of a system in accordance with the present invention 
a home AV interoperability architecture, a series of home AV 
interoperability interfaces, and a home AV network. The home AV 
interoperability architecture is a broad, over arching term encompassing 
the physical network and the controlling programming interfaces. 
Interoperability interfaces is a term used to describe the interactions and 
interfaces of the components of the AV architecture. In addition to 
providing a common command set, the interoperability interfaces provide a 
software architecture which allows new devices to be integrated into the 
network and provide their services in a seamless manner. The home AV 
network is the term used to describe the physical network and its topology. 

It should be noted that the home AV interoperability (HAVI) 
25 architecture of the present invention is an open, platform-independent, 
architecturally-neutral network that allows consumer electronics 
manufacturers and producers to provide inter-operable appliances. It can 
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be implemented on different hardware/software platforms and does not 
include features that are unique to any one platform. The interoperability 
interfaces of the HAVI architecture are extensible and can be added to, 
modified and advanced as market requirements and technology change. 
5 They provide the infrastructure to control the routing and processing of 
isochronous and time-sensitive data (e.g., such as audio and video content). 

Specifically, the HAVI architecture provides: an execution 
environment supporting the visual representation and control of 
10 appliances; application and system services; and communication 

mechanisms for extending the environment dynamically through plug and 
play or otherwise. 

It should be noted that the HAVI architecture supports legacy 
15 appliances (e.g., appliances that already exist and are available to users). 
This is important since the transition to more intelligent networked 
appliances is going to be slow. Most manufacturers will not suddenly begin 
producing only "intelligent" appliances and most consumers will not 
quickly begin replacing all of their existing appliances. 

20 

In accordance with the present invention, there are two classes of 
legacy appliances. A first class includes "one-way" or unacknowledged 
control appliances. A second class includes controllable "two-way" 
appliances. Examples of one-way appliances are audio/video components 
25 controlled by infrared commands of a hand held remote. Two-way 

appliances provide confirmation of command execution, status and error 
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reporting. Examples of two-way appliances include the recent introduction 
of well known IEEE 1394 enabled digital cameras. 

It should be noted that the home AV network (hereafter HAVI 
5 network) of the present invention provides support to accommodate future 
appliances and protocols through a write-once, run-everywhere common 
language. In accordance with the present invention, each appliance 
includes within it self-describing information concerning the user interface 
and the device control that can be used by an external controller. This 
10 information is specified as programs in the common language. 

As described below, the underlying structure for such a network 
consists of set of interconnected clusters of appliances. Typically, there will 
be several clusters in the home, with one per floor, or per room. Each 
15 cluster will work as a set of interconnected devices to provide a set of 

services to users. Often, .one device will act as a controller for a set of other 
devices. However, the architecture is sufficiently flexible to also allow a 
home to consist of a single cluster with no master controller. 

20 For example, in one embodiment of the present invention, an 

intelligent television in the family room of a user's home might function as 
the controller for a number of interconnected appliances. Each of the 
controlled appliances would have self describing data and possibly some 
associated control code. When these appliances are first connected, the 

25 controller obtains the user interface and the control program for the 

appliance. An icon representing the appliance may then appear on the 
television screen, and manipulating the icon may cause elements of the 

15 
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control program to actuate the represented appliance or appliances in 
prescribed ways. The exception to this model are legacy devices which will 
have neither self describing data or control code. For addition descriptions 
and related art regarding self describing data, the reader is referred to 
5 Ludtke, et aL, A METHOD AND APPARATUS FOR INCLUDING SELF- 
DESCRIBING INFORMATION WITHIN DEVICES, provisional 
application number 60/054,327, filed on July 31, 1997, which is incorporated 
herein by reference. 

10 It should be noted that the HAVI network of the present invention 

supports "Plug and Play" consumer appliances are easy to install, and 
provide a significant portion of their value to the consumer without any 
action on the user's part, beyond physically connecting the cables. This is 
in distinction to existing appliances that require configuration to provide 

15 some major portion of their functionality. The goal is to offer 'hot 1 plug and 
play (not requiring the user to switch off appliances) where the connection 
method supports it safely and reliably. 

In accordance with the present invention, an appliance configures 
20 itself, and integrates into a system-wide "look and feel" user interface, 
without user intervention. Low-level communication services provide 
notification when a new appliance is identified on the AV network. While 
there will often be settings the user may change to suit his or her 
preferences, the appliance does not require the user to do so in order to offer 
25 basic functionality. 
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It should also be noted that the HAVI network of the present 
invention is flexible and supports multiple user interfaces, adapting to both 
the user ! s needs and the manufacturers need for brand differentiation. In 
the AV network, protocols scale gracefully from very resource-rich, 
5 intelligent PC-like appliances to "dumb", resource starved appliances (e.g., 
a coffee maker or thermostat). To achieve this, the AV architecture allows 
low-end appliances to use the resources of more intelligent appliances in 
well-defined ways. In a similar manner, the AV architecture allows the 
specification of aggregate appliances where an abstract appliance is 
10 created from a logical collection of several lower-level appliances. 

And additionally, it should be noted that the HAVI network of the 
present invention supports existing standards. The HAVI network is 
complementary to several existing, well known, industry standards and 
15 technologies including: CEBus; Home Plug and Play; EHSI; VESA; Home 
Network, DAVIC, CoMMeND, Lonworks, USB, IEEE 1394, etc. 
Accordingly, one goal of the present invention is to provide an 
infrastructure into which existing devices can fit. 

20 THE SYSTEM MODEL, OF THE HAVI ARCHITECTURE 

With reference now to Figure LA, a HAVI network 10a in accordance 
with one embodiment of the present invention is shown. As described 
above, the HAVI architecture supports a wide range of devices including 
intelligent receiver/decoders (IRDs), for example, the set top box 301, digital 

25 video tape records (DVTRs), video cassette recorders (VCRs), personal 
computers (PCs), digital video disk players (DVDs), etc., communicating 
via a common messaging system. Figure 1A illustrates the physical port- 

17 
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to-port connecting configuration 10a of an exemplary HAVI network. CE 
devices ("devices") 12-24 are shown connected together with bus segments 
30a-30f. In one embodiment of HAVI, the IEEE 1394 serial communication 
bus standard is used as a platform to provide the common messaging 
5 system. 

Figure IB illustrates a logical bus configuration 10b of the HAVI 
network of Figure 1A As shown in Figure IB, all of the devices 12-24 of the 
HAVI network can be viewed as logically coupled to a common IEEE 1394 

10 serial communication bus 30. Within this bus configuration 10b, peer-to- 
peer device communication is supported. For example, as shown in Figure 
1C, any device (having appropriate capabilities), e.g., device 12, can send or 
receive communication packets from any other device in the HAVI 
network. In the example of Figure IB, the set-top-box (e.g., an IRD) can 

15 receive messages from or generate messages to any of the other devices 14- 
24 of the HAVI network. 

Referring still to Figures LA and IB, as described above, the 
interoperability model in HAVI provides for the following: 1) support for 

20 existing devices; 2) a default control model; 3) a means to extend the default 
control model when new devices or functionality is brought to market; and 
4) a common means for device representation (e.g., graphics user 
interfaces). To achieve the above, the HAVI architecture defines three 
types of nodes in the home network: Full AV nodes (FAV), Intermediate 

25 AV nodes (IAV) and Base AV nodes (BAV). 
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A Full AV node is a device that contains a complete instance of the 
AV software model (described in detail below). This type of node generally 
has a richer set of resources and is capable of supporting a complex 
software environment. The primary distinguishing feature of a FAV is 
5 that it is able to take control responsibility for less sophisticated devices and 
does this by loading a control module, usually from the less sophisticated 
device, and executing it locally. Examples of such nodes would be Set Top 
Boxes (e.g., set top box 301), Smart TVs, general purpose home control 
devices, or even Home PC's. 

10 

Intermediate AV nodes are generally lower cost devices that have 
limited resources. They do not provide an execution environment for 
control modules and so can not act as master controllers within the home 
network. Because they have limited resources, they can access remote 

15 resources in one of two ways: by working with other IAV devices who 

provide some capability they lack, or by using an FAV node which supports 
a control module to control them. In this second mode of operation they 
rely on full AV nodes to provide such facilities as a display device, general 
purpose compute resources and some overall control framework. This 

20 allows Full AV devices to bind a variety of intermediate AV devices together 
to provide a service or abstraction to the user. 

Base nodes are nodes that are neither FAV or IAV nodes. These are 
two generic types: Legacy base nodes, and other base nodes. Legacy base 
25 nodes are devices that were built before the advent of the HAVI 

architecture. These devices often use proprietary protocols for their control, 
and quite frequently have a simple, well defined, control only protocol. 

19 
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Such devices can work in the HAVI network but require that a Full AV 
node act as a gateway. Communication between a Full or Intermediate AV 
node and legacy devices requires that the Home AV commands used in the 
HAVI architecture be translated to and from the legacy command protocol. 
5 Other base nodes are devices that, for business or resource reasons, choose 
to implement future proof behavior using uploadable control software and 
do not carry any of the HAVI architecture or the message communication 
system. These devices will be controlled by an FAV node with a private 
command protocol between FAV and BAV node. 

10 

With the exception of legacy nodes, each node has, as a minimum, 
enough functionality to allow it to communicate with other nodes in the 
system. During the course of interaction, nodes exchange control and data 
information to enable devices to inter-operate and will do so in a peer to peer 

15 fashion. This ensures that, at the communication level, no one device is 
required to act as a master or controller for the system. However, it also 
allows a logical master or controller to impose a control structure on the 
basic peer to peer communication model. Services in the HAVI network 
are provided by one or more nodes communicating amongst themselves to 

20 deliver a service to user or an application. Where it is necessary for a node 
to interact with a user, then the node negotiates with other nodes to access 
and use a display device. 

Additionally, it should be appreciated that a distinction is made 
25 between Logical and Physical nodes. A good example of this distinction can 
be found in a normal TV set. Although the TV set is generally one physical 
box, it contains several functional components, e.g. the tuner, audio output 

20 
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etc. From the system point of view a physical node is an addressable peer 
node in the system. If the TV is constructed in such a way that its 
individual functional components are individually addressable, then it is 
logically one node and physically several nodes. Conversely, if it is 
5 constructed to have one addressable entity, then it is both a single logical 
node and a single physical node. 

The LAV devices and FAV devices communicate by sending 
messages over the home network using a generic message passing system. 

10 When new devices join the home network, they are recognized and added to 
a global name database (registry). The registry holds information about 
their characteristics and provides a reference to a handler for that device. 
Other devices and services are able to query the registry to locate a device 
and then using the handler, can interact with the device. For additional 

15 descriptions and related art regarding the communication and 

identification processes of the present invention, the reader is referred to 
Ogino, et al., "METHOD AND SYSTEM FOR PROVIDING A DEVICE 
IDENTIFICATION MECHANISM WITHIN A CONSUMER 
AUDIO/VIDEO NETWORK", a US patent application filed on 6, Jan, 1998, 

20 which is incorporated herein by reference. 

When a device is initially added to the home network, the system 
queries the device to ascertain its characteristics and capabilities. Once a 
device's characteristics are known, the architecture provides two methods 
25 of controlling it. The first method, level 1 interoperability uses a predefined 
message set. All IAV and FAV nodes can use this command set to access 
and control other devices (BAV nodes, because they are deployed before the 

21 
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architecture was defined, are controlled using legacy protocols). The 
provides a default level of control. The FAV nodes act as control nodes and 
create a local representation of the IAV node, known as a device control 
module (DCM) that provides an API used to send control commands to the 
5 device. 

Level 2 interoperability within HAVI goes farther and supports 
future added functionality and new devices. To achieve this, a particular 
device can carry within its ROM, an override DCM that is uploaded from 

10 the IAV device, to the FAV device and replaces the default DCM for the 
particular device. This override DCM not only contains the basic level 1 
command set for the particular device but also includes vendor specific 
commands to control advanced features of the device. The model allows the 
device to inform another about its particular functionality. Since the 

15 override DCM may be loaded onto any vendor's FAV, the format of the DCM 
is architecture-neutral . 

To allow one device to discover the capabilities of another device and 
to determine which command set to use with that device, a standard device 

20 description structure is provided called the self describing data (SDD) 

structure. The SDD data structure is extensible. It can be a small number 
of bytes describing the device type, e.g., TV, or VTR, etc. Alternatively, the 
SDD data structure can be a more complex structure also defining the 
override DCM and a graphical representation of the device. The graphical 

25 representation within the SDD data structure allows an FAV node to 
present a pictorial representation of the devices in the home network to 
users. By defining the graphical representation in a sufficiently generic 

22 
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manner, a device's SDD graphical data can be used in any vendor's product 
to display a user interface for that device. This provides an enhanced level 
of vendor interoperability and also allows a vendor to differentiate a product 
while maintaining within the general look and feel of the display device. 
5 This enables a control device (the FAV node) to present a general control 
user interface for all devices in the home network, irrespective of the 
differences in type and vendor. 



As described above, Legacy devices are devices that were built before 
10 the HAVI architecture or devices that select not to use HAVL HAVE 
supports Legacy devices by providing Legacy DCMs to provide protocol 
conversions for Legacy devices. These Legacy DCMs can contain sufficient 
knowledge to allow them to support an existing 1 or 2 way control protocol 
and provide a specific control interface to the devices that conform to HAVI. 
15 A legacy DCM acts as a bridge between the Legacy and HAVI devices. This 
approach allows HAVI also to interact with any future device control 
protocols such as protocols being used for home energy management or 
security. 



20 It should be appreciated that the communications hardware and 

protocols used by the HAVI architecture are non-specific. The HAVI 
architecture is readily suited to the incorporation and use of any one of 
several communications mediums, with the simple requirement that the 
medium provides a generic communication mechanism that supports the 

25 HAVI interfaces. The basic model assumed is one of a logical 

communications back plane (e.g., IEEE 1394). All AV devices are assumed 
to be connected to this back plane, and can locate and communicate with all 
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other AV devices, as shown in Figure IB. In a physical setting, it is likely 
that this logical back plane will consist of more than one physical 
communication medium. It is further assumed that multiple protocols 
may be in use on different physical media. The Home AV architecture 
abstracts above all of this and presents a generic model of communicating 
nodes. It will provide a mechanism above the Transport layer (functionally 
like a socket) to ensure network transparency. This mechanism can be 
described as "reliable, ordered datagram service* which will provide all 
fragmentation and re-assembly. 



0 



Accordingly, a goal of the present invention is to support each and 
every physical bus the same, such that an application need not care which 
physical transport it is using. However, with the familiarity, of IEEE 1394 in 
the electronics industry, features of the present embodiment are illustrated 
5 and described in view of functioning with IEEE 1394. Other buses such as 
CEBus and USB may not require all the same features. 

Referring now to Figure 2, an exemplary peer to peer, two IAV node 
HAVI network 200 in accordance with one embodiment of the present 
invention is shown. HAVI network 200 includes a first IAV 201 (e.g., a 
television) coupled to a second IAV 202 (e.g., a receiver). IAV 201 and IAV 
202 behave in a peer-peer manner, arbitrating for necessary resources 
amongst one another. They lack the resources to support the addition of a 
BAV or LAV device, but can perform meaningful activities within their 
context. The IAV is not required to provide any standard UI capability. 
There is no provision in the AV Architecture for "forward compatibility" or 
discovery of new functions (e.g. IAV 201 only knows the functions that IAV 
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202 supports based on SDD provided upon connection of IAV2). However, 
in accordance with the present invention, the features of the SDD can be 
easily exploited to perform "ad-hoc" feature discovery. 

5 Figure 3 shows a single FAV cluster HAVI network 300 in 

accordance with one embodiment of the present invention. HAVI network 
300 includes an FAV 301 (e.g., a set top box) respectively coupled to a first 
LAV 302 (e.g., a television) a second LAV 303 (e.g., a VCR) and a BAV 304 
(e.g., a digital camera). In HAVI network 300, 
10 FAV 301 controls Legacy and Base AV devices (e.g., devices 302-304), 
providing cluster-wide services. 

Figure 4 shows an FAV cluster integrated with an IAV peer to peer 
HAVI network 400. In accordance with the present invention, the 

15 configuration of HAVI network 400 provides support for legacy devices 302 
and 303 while enabling independent control to occur within the two IAV 
devices 401 and 402 when their resources are not in use by the FAV device 
301. The IAV devices 401 and 402 behave as peers to the FAV device 301. 
For efficiency, a resource conflict policy can be implemented for both FAV 

20 to FAV or FAV to IAV resource requests. The IAV will be controlled by the 
FAV by via a DCM running in FAV 301. 

Figure 5 shows an exemplary HAVI network 500 having multiple 
FAVs. HAVI network 500 includes an additional FAV 501 (e.g., a satellite 
25 receiver). This configuration behaves in a similar manner to HAVI 

network 400 described above. In this configuration, the FAV devices 301 
and 501 act as peers. 

25 
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THE COMPUTER SYSTEM PLATFORM 

With reference now to Figure 6, a diagram of a set top box 301 in 
accordance with one embodiment of the present invention is shown. As 

5 described above, any consumer electronics device can be a FAV and thereby 
provide a computer system platform for HAVI software. For instance, the 
set-top^box 301 device of the exemplary HAVI network contains special 
components that provide an operation platform for software components of 
the HAVI architecture which are described below. Specifically, aspects of 

0 the present invention, described below, are discussed in terms of steps 
executed on a computer system (e.g., processes shown in Figures 13 
through 17A). Although a variety of different computer systems can be 
used with the present invention, an exemplary general purpose computer 
system is shown in the set-top-box of Figure 6. 

5 

Set-top-box 301 of Figure 6, in addition to having a video/audio 
receiver (decoder) unit 606 and MPEG unit 607 also includes an 
address/data bus 600 for communicating information, one or more central 
processors 601 coupled with the bus for processing information and 

3 instructions, a volatile memory 602 (e.g., random access memory RAM) 
coupled with the bus 600 for storing information and instructions for the 
central processor 601 and a non-volatile memory 603 (e.g., read only 
memory ROM) coupled with the bus 600 for storing static information and 
instructions for the processor 601. Set-top-box 301 can also optionally 

5 include a data storage device 604 ("disk subsystem") such as a magnetic or 
optical disk and disk drive coupled with the bus 600 for storing information 
and instructions. Also included in the set-top-box 301 is a bus interface unit 
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608 for interfacing with the local bus 30 (e.g., an IEEE 1394 serial bus). Set- 
top-box 301 can operate under a variety of different operating systems (e.g., 
Windows operating system, DOS operating system, Macintosh O/S), but in 
the present embodiment the Aperios operating system is used. 

5 

THE HAVT SOFTWARE MQDRT, 

In accordance with the present invention, the computational units of 
the HAVI architecture (e.g., DCMs) are modeled as objects. Each object is 
a self contained entity, accessible through a well defined interface and 
10 executing within a well defined software execution environment. The 
software execution environment (e.g., set top box 301 from Figure 6) 
provides a set of well defined services (locally or remotely) that are also 
modeled as objects and can be accessed, using the communications 
infrastructure, via their well defined interfaces. 

15 

Each object is uniquely named. No distinction is made between 
objects used to build system services and those used for application services. 
All objects make themselves known via the registiy. Objects in the system 
can query the registry to find a particular service or device and can use the 
20 result of that query to send messages to that service or device. The 

identifier assigned to an object is created when the object registers. This 
identity, if required, is guaranteed to be persistent during the lifetime of the 
object and will remain persistent even in the face of a complete reboot of the 
home network. 

25 

In accordance with the present invention, the objects communicate 
using a message passing model. An object that wishes to use the service of 
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another object, does so by using a general purpose message passing 
mechanism that delivers the service request to the target object. The target 
object is specified using the unique object identifier discussed above. While 
in the present embodiment the message passing mechanism functions 
5 with IEEE 1394, it should be noted that there is no distinction between 
sending a message across a 1394 bus, or over a Control Al link. In the 
same manner, there is no distinction between objects on the same node and 
one on a remote node. The actual implementation of the message passing 
infrastructure will depend on the system and networking environment and 
10 will differ from node to node and between vendors. However, the actual 

format of the messages must be common so that interoperability is assured. 

It should be appreciated that the general intent of the object model 
and messaging system is to provide a completely generic software model 
15 that is sufficiently flexible to allow multiple implementations with a variety 
of software systems and languages. Details of the binding between 
messages and the code that handles them are left to the system 
implementor. 

20 SOFTWARE ARCHITECTURE OVF.RVTF.W 

The HAVI software architecture defines the way that the software 
model is used to support the HAVI architecture. In particular it defines 
the way that devices are abstracted and managed within the AV 
architecture. It defines the ways that interoperability is assured, and it 

25 defines the ways that future devices and services can be integrated into the 
architecture. 
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Full AV nodes as software managers: In accordance with the 
present invention, Full AV nodes (FAVs) act as managers for Intermediate 
(IAVs) and Base (BAVs) nodes and provide a platform for the services that 
support the HAVI architecture. To achieve this they provide an execution 
5 environment which allow objects to control and communicate with services 
and devices. To ensure that devices are accessible within the Home AV 
network, the FAV nodes support a software abstraction of the services that 
a device offers to others. As described above, this abstraction is referred to 
as a device control module (DCM). The DCM is modeled as an object within 

10 the software architecture but is refereed to hereinafter simply as the DCM 
to distinguish it. The interface that the DCM exposes to the rest of the 
system provides the means to access and control that device. In the general 
case, a FAV will manage a set of DCMs, one for each LAV node and base 
node in the home network or portion of the IAV network that it manages. 

15 Thus, it should be appreciated that from an interoperability perspective, the 
primary role of the FAV node is to manage DCMs of the present invention 
and act as an execution environment for DCMs. 

Full AV node as controller and display device: In accordance with 
20 the present invention, in most cases, FAVs will have an associated display 
device which is used for display of AV content and of user interface (UI) 
material. However, the HAVI software architecture does not mandate this 
and FAV nodes may be "headless*. In this case they will cooperate-operate 
with other nodes to display content and UI information (see below). 
25 However, FAV devices will be responsible for supporting the high level UI 
APIs that provide the look and feel of the entire home network. The lower 
level graphic manipulation APIs will generally be located close to the 
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graphics display device itself and are manipulated by the FAV high level 
APIs. 



Peer to peer architecture between full AV nodes: In a Home AV 
5 network in accordance with the present invention, there may be more than 
one FAV. In this case, each FAV cooperates with other FAVs to ensure 
that services ore provides to the user. This allows FAV nodes to cooperate 
to share resources. For example, an FAV node that does not have direct 
access to a display device, may use a remote FAV node to display DCM user 
10 interfaces. Alternatively, a FAV node may require the services of a data 
translation module that exists on a remote node to allow it to set up a data 
route between two AV devices. 

LEVEL 1 AND T.EVEL 2 INTEROPERABILITY GENERALLY 
15 111 accordance with the present invention, one of the major goals of 

the HAVI architecture of the present invention is to support interoperability 
between devices. This includes existing devices and future devices. To 
achieve that interoperability, the HAVI architecture of the present 
invention supports a general model that allows two levels of 
20 interoperability. These levels are referred to as Level 1 and Level 2. 

Level 1 interoperability: Level 1 interoperability of the present 
invention addresses the general need to allow existing devices to 
communicate. To achieve this, level 1 interoperability of the present 
25 invention defines and uses a generic set of control messages (commands) 
that enable one device to talk to another device and a set of event messages 
that it should reasonably expect from the device. To support this approach 
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a basic set of processes are required. These processes include device 
discovery, communication, and a generic message set. 



The device discovery process of the present invention provides for the 
5 fact that each device in the Home AV network needs a well defined method 
that allows it to advertise to others its characteristics. The approach we 
have adopted is to specify a data structure, required on ail FAV and IAV 
devices, that contains information about the device and which can be 
accessed by all other devices. This data structure is referred to as a Self 
10 Describing Data structure (SDD). The SDD contains, as a minimum, 

enough information to allow another device to discover its basic capabilities 
and so infer the basic set of command messages that can be sent to that 
device and events it should reasonably expect to receive from that device. 

15 The communication process of the present invention provides for the 

fact that once a device has determined the capabilities of another device, it 
then needs to be able to access those capabilities. To achieve that requires a 
general communication facility that allows one device to send a message 
containing a command request to another device. The general message 

20 service processes of the present invention were discussed above. 

Generic message set refers to the process required to support level 1 
interoperability. This includes a well-defined set of messages that must be 
supported by all devices of a particular class. This ensures that a device 
25 can work with other devices, irrespective of the manufacturer, because all 
devices agree to a common set of generic commands. As discussed above, 
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within the HAVI software architecture of the present invention, these 
commands are presented as a DCM to the rest of the system. 



These three basic processes of the present invention support at least a 
5 minimal level of interoperability. Since, in most cases, any device can 

query the capabilities of another via the SDD, any device can determine the 
command set supported by another device. And since each device has 
access to a generic messaging system, then any device can interact with 
any other device. 

10 

However, it should be appreciated that level 1 compatibility in 
accordance with the present invention only ensures that devices can inter- 
operate at a minimal or degraded level of functionality. The generic 
message set for each device class is a minimal and common set of 

15 commands. The SDD facility offers a means to provide some degree of 
customization of a device by providing information about its UI and some 
aspects of its interaction model. Other IAV devices can use this 
information to present an interface to the device. Alternatively, any FAV 
device can use this information to customize the generic DCM it has 

20 created for the device. However, it should be noted that a more extensible 

mechanism is also needed to allow a device to communicate to other devices 
any additional functionality it posses. Level 2 interoperability of the present 
invention provides this mechanism. Level 1 and Level 2 interoperability are 
discussed in greater detail below. 

25 

LEVEL 1 AND T/E VEL 2 DCMs 
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As described above, the DCM of the present invention functions by 
providing access, control and interaction with a device. DCMs are typically 
instantiated (e.g., executed) on the resources of FAVs in the Home AV 
architecture. The DCM of the present invention provides an interface to a 
5 device and manages a UI that the device wishes to present to users. 

In accordance with the present invention, with the level 1 
interoperability, the DCMs created for devices are generic. They support a 
minimal command set that allows generic control of the device. To support 
10 device specific features requires that the DCM provide access to such device 
specific features and is capable of presenting device specific features to 
users via the UI. 



To achieve this, Level two interoperability is used. In accordance 
15 with the present invention, the Home AV architecture allows a device to 
provide an "override" DCM for the generic DCM that would normally be 
created for that device. The override DCM (e.g., level 2 DCM) is capable of 
replacing the default DCM (e.g., level 1 DCM) on the FAV. It should be 
appreciated that the level 2 DCM could be retrieved from a variety of 
20 sources. One such source is the SDD of the device itself. In this case, the 
level DCM is fetched, received, or otherwise acquired from the SDD of the 
device and instantiated in an FAV node when the device is installed into the 
system. Because the Home AV architecture is vendor neutral, it is 
necessary that the level 2 DCM work on a variety of FAV nodes, each with 
25 potentially different hardware architectures. To achieve this, the format of 
both the level 1 and level 2 DCMs of the present invention are architecture 
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neutral such that a wide variety of software execution environments of the 
FAV nodes are able to instantiate and run the level 1 and level 2 DCMs. 

It should be appreciated that, in accordance with the present 
5 invention, once created and running within a FAV node, the DCMs of the 
present invention communicate with the IAV and BAV nodes in the same 
manner as described above using the basic messaging mechanism. 

As described above, there are many permutations of FAV, IAV and 
10 BAV nodes possible within a given HAVI network. These permutations 

generally fall into two types: HAVI network configurations that support an 
FAV device, and those that do not. This distinction essentially defines 
whether a HAVI network will be using a peer to peer configuration (e.g., as 
shown in Figure 2, where no FAV is present) or will be imposing some 
15 form of control hierarchy (e.g., the FAV cluster as shown in Figure 3). 

In accordance with one embodiment of the present invention, in the 
cases where no FAV is present, only level 1 interoperability is available and 
the devices are forced to use SDD information to discover other IAV 
20 capabilities, present those capabilities, and control the device. In the cases 
where FAVs are present, DCMs are instantiated and uses. If these are 
level 1 (e.g., generic) DCMs, the devices are operating at level 1 
interoperablity. If there is at least one level 2 DCM present, then some of 
the devices are operating at level 2 interoperability. 



25 



In accordance with the present invention, it should be noted that a 
mixed mode of operation is possible in which clusters of devices are inter- 
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operating under control of an FAV node, while other devices are inter- 
operating in a peer to peer fashion. In this manner, the flexibility of the 
present invention allows vendors the freedom to design and build devices 
ate all points on the cost/capability spectrum with the certainty that these 
5 devices will inter-operate seamlessly with other devices in the HAVI 
network. 



Referring now to Figure 7, a logical block diagram 700 of one 
embodiment of the HAVI architecture is shown. Figure 7 shows an overall 
10 HAVI architecture in accordance with the present invention. The 
components shown in diagram 700 are as follows: 

Device manager 761: Device manager 761 is responsible for creating 
and managing the DCMs that represent devices managed by an FAV 
15 device. 

Device Modules 720: These are the DCMs for individual devices. As 
described above, each DCM functions as a control point for a device and 
provides a UI component and a control component. The DCMs (e.g., device 
modules 720) provide an API to allow other applications to access and 

20 manipulate the devices. 

Service Modules 730: These modules can be viewed as software 
devices They are DCMs for any software component (as opposed to a 
hardware device) that provides a general service to other devices or 
components in the home network. 

25 Comms Media Manager 740: This component is responsible for 

managing the underlying physical communications process. It provides 
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an API that allows code modules to interact with the features of the 
communications media (e.g., IEEE 1394). 

Registry 706: This is a service database. All DCMs for physical 
devices and software services will register themselves in the registry 706 
5 and all modules (e.g., device modules 720) can query the registry to get a 
handle for another device or module. 

Communications manager 750: This component is a low level 
abstraction of the communications media. 

Messaging 702: This component provides a basic message passing 
10 facility to allow both devices (hardware) and device modules 720 and service 
modules 730 to communicate with each other. 

Event Manage 703: This module provides a generic event service. 
This is a one-to-many communication service allowing notification in the 
HAVI network. 

15 Initialization manager 701: This component is used as part of the 

device bootstrap process. 

Data routing 762: The data routing component 702 is responsible for 
helping services set up routes between devices and devices modules. It 
takes into consideration the 'cost* of transferring data via a particular 
20 route, the requirements on data format translation etc. This component is 
not needed for the basic architecture. 

AV Actions/Macros 763: this component is a manager for higher 
level AV actions which are groups of individual low level commands, i.e. it 
provides a macro service. This component is not needed for the basic 
25 architecture. 

High level UI library 704: This component provides a set of high level 
UI components that are used by device modules 720 to build UIs for their 
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corresponding devices. This component is not needed for the basic 
architecture. 

Application (and User) interface 705: This component provides the 
linkage between a common consumer electronics platform (CCEP) APIs of 
5 the HAVI compliant devices and applications which are local or possibly 
remote. This component is not needed for the basic architecture. 

It should be appreciated that the above components as diagrammed 
in Figure 7 are abstractions of functionality. They are designed to make 
10 clear what functionality is included in the architecture for HAVI compliant 
devices. In order to avoid unnecessarily obscuring the present invention, 
the relationship between components 701-763 and the message flows 
between them are not shown. 

15 PCM CONFIGURATION AND FUNCTION 

Overview 

In one embodiment of the present invention, in HAVI network 
configurations where a FAV node is available, a DCM exists for each 
20 physical device in the HAVI network known about by that FAV node. The 
DCM provides an interface to the device and presents it as an object in the 
architecture. Other DCMs, system services or application services can 
query the local registry to find out the devices available and to get an 
identifier to allow them to interact with the devices via its DCM. 

25 

Device control modules are also responsible for interacting with the 
software architecture to present the device user interface (UI) to the user. 
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Input from users is then passed to the DCM which uses the input to control 
the actual device. 

As discussed above, DCMs support the level 1 and the level 2 
5 interoperability. A level 1 DCM is a generic DCM, usually supplied with 
the FAV node, and capable of managing a basic, pre-defined set of features 
of a device class using a pre-defined message set. During initialization, 
the DCM will work with the Device manager (below) to discover the actual 
characteristics of the device to be managed, and will configure itself to 
10 control that device. Thus a generic VCR controller could be instantiated to 
control a standard VCR using either 1394 AV/C messages, or via Control 
Al. 

In the case of level 2 interoperability, the DCM instantiated for that 
15 device will be an override DCM that has been loaded from an external 
source, e.g. the device itself. These override DCMs are written in the 
common language format for DCMs. The functioning of an override DCM 
doesn't differ from generic ones but the API offered is likely to be more 
comprehensive . 

20 

Once instantiated, DCMs will provide not only control interfaces for 
the device, but also access to SDD data associated with a device. They will 
act as event managers for a device, receiving device specific events and 
posting those to the event system (see below). They will also act as UI 
25 manager for the device, interacting with the UI management system to 
provide a user interface via some display device. Lastly, the DCM will 
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operate as a resource manager for devices, arbitrating requests made for 
device access and service. 

Qenerfll PCM tenprnotagy 
5 In the terminology of the present invention as used in the following 

descriptions, each DCM presents a model of a device in the home network. 
The basic terminology used is as follows; 

1) Device: This term refers the entire device. 
10 2) Subdevice: This term refers to one of possibly many components 

that make up a device. Some technologies do not have the ability to 

distinguish subdevices. 

3) Internal Connection: This term refers to the logical or physical 

connection between internal subdevices. 
15 4) External Connection: This term refers to the connection between a 

physical connector on the outside of a device and a destination device 

outside the device. The same as unit Serial Bus and external input and 

output plugs for AV/C. 

5) Protocol: This term refers to the control protocol spoken by the 
20 sub-device or device (e.g., AV/C, Control Al, etc.). It should be note that a 

device may contain subdevices which speak different protocols. 

6) Interface: This term refers to the physical bus connection 
interface (1394, USB, etc.). 

7) Device Class: This term is one way to describe the basic 

25 functionality of a given collection of devices. For example, the class of 

DVCR devices can record data to a tape medium. Likewise, there may be 
many devices that can take audio input, perform some kind of special 
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effects, and output the modified audio stream. These would all come under 
the class of audio processor or something like that. The usefulness of this 
concept will become more apparent later in the document. 

8) Device Model: This term refers to the collection of subdevices and 
connections that make up either a standard or custom device definition. 
Individual subdevices that are accessible within physically separate devices 
can be combined to form logical or virtual devices using the device model. 
9) Standard Device: This term refers to standard model definitions (e.g. a 
DVCR device is composed of at least a timer subdevice and a VCR 
(transport) subdevice, with plugs between them). 

10) Special Device: This term refers to a vendor-specified device 
model, composed of either standard subdevices or a combination of 
standard and vendor-specific subdevices. For example, a dual deck DVCR 
may have two VCR subunits, which are standard items, but in a non- 
standard configuration. 

11) Aggregate devices: This term refers to logical entities which can 
be combined from a variety of components. Physical devices and subdevices 
are individually accessible pieces of hardware. When devices have 
accessible subdevices, this model is extended to support aggregate devices. 
Examples of aggregate devices include subdevices from separate physical 
devices or within a single device, and software modules such as software 
codecs which provide services or capabilities similar to devices and 
subdevices. These modules can all reside in the same node on the AV 
network, or can be distributed among many nodes.. 

Device classification 
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Device access and control 

In accordance with the present invention, once a basic device 
classification has been made, then the generic DCM instantiated for that 
device will provide an API that causes control messages to be sent to that 
5 device. The base set of control messages that can be sent or received (in the 
case of events) to a particular class of device are standardized and detailed 
in the appendix (not available in this version of the document). In the 
present embodiment, these messages represent a basic API presented by 
- the DCM. 
10 

Device manafrgyn^f 

In accordance with the present invention, the DCM API also 
provides a set of higher level services that allow more sophisticated 
management of the device. Examples of this include device reservation and 

15 event management. In the case of device reservation it is likely that a 

request for a device may be refused due to existing requests on the device, 
alternatively, the device request may be for a future reservation for a time 
based macro. In these cases the DCM provide an interface to allow an 
application or service to queue requests with the DCM, i.e. reserve a device, 

20 or to receive notification when a device becomes available. 

Connection manayrpmpnt. 

The DCMs of the present invention also provide a high level API to 
allow other objects to query the state of connections between devices and to 
25 manipulate those connections. This API is primarily used by the Route 
manager but is available to any object in the system. Connection 
management allows connections to be established, both internally between 
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subdevice units, and externally between devices. Connection status can be 
queried and connection capabilities (signal formats) can also be queried. 
SDD management 



5 The DCMs of the present invention also provides a generalized 

interface to SDD management. This allows the SDD data in the device to 
queried and used. The API is divided into two parts, part 1 provides APIs 
for getting well know information from the SDD data including the 
Devicelmage, its name and the URL (if available) of a location for an 
10 override DCM or other icons to be used in representing the device's UL 
Part 2 of the SDD API is designed to provide more detailed access to 
functional aspects of the device. 

Device representation and user interface (UP 
15 In accordance with the present invention, the DCM is also 

responsible for the UI aspects of the device. In the case of level 1 
interoperability, a generic UI is used to interface with users. This may be 
augmented by basic SDD data that allows such aspects as UI icons to be 
specified and accessed by the generic DCM. In order to avoid unnecessarily 
20 obscuring the present invention, the details of how the DCM interacts with 
the UI management system to present a device specific UI is not discussed 
in detail. In the present embodiment, however, the basic model is that 
internal management code within the DCM works with the UI 
management system to present a UI for the device. User input is then 
25 forwarded by the UI management system, to the DCM which then converts 
it into device specific commands. These commands are sent, using the 
basic messaging system^ to the device. If replies are received then these are 
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Classifying devices based on the kind of actions they perform, or the 
kind of medium they deal with, is a way of allowing us to create a 
generalized control API that will work for devices that are created in the 
future. The intent is to allow a high percentage of basic functionality to 
always be accessible regardless of the type of device or the manufacturer of 
the device. 

Any manufacturer-specific or device-specific functionality that is 
controllable as well but falls outside of the generalized control API will only 
be accessible via the SDD information and other techniques for extending a 
DCM. 

In the most general terms, the classification of devices or subdevices 
can be described by their main functionality. The AV/C control protocol of 
the 1394 standard uses a convenient method of classifying devices which we 
have adopted below. Following is the first set of factors used for classifying 
a device or subdevice: 

1) Whether a particular device has a transport mechanism. 

2) Whether the usefulness of this subdevice defined mostly by the fact 
that a signal ends up here (regardless of the fact that it may be propagated 
without changes). 

3) Whether a particular subdevice a signal source (e.g., does it have 
a signal output). 

4) Whether a particular device accepts input, performs some sort of 
processing, and then outputs modified data. 
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5) Whether there is no signal input or output of any kind (e.g., is the 
device a utility of some kind, such as a mechanism for positioning a 
satellite antenna). 

5 In accordance with the present invention, at a second level of 

classification, we can study devices that contain a transport mechanism. 
In this case, a general question would be "does this device deal with 
removable media?". If it does, then a basic set of controls is applied, such as 
PlayO, StopO and even Search(). Devices with media can be queried for 
10 their ability to record, to determine the organization of information on the 
medium (is it track-based? continuous such as a tape? how is it measured - 
SMPTE time codes, time offset from a certain position, etc.). 

In the present embodiment, a signal processing service can be 
15 described by the kind of signal(s) it can accept, and the kind it can produce 
as a result. This requires the establishment of common definitions for 
describing signal types and methods for accessing the services, so that any 
client can know how to describe what kind of service it is looking for, and 
how to access that service. 

20 

Any device which accepts one kind of data and has the ability to 
transmit that data on a different type of connection (for example, it takes 
digital video as input and has standard analog video RCA jacks which can 
send that data back out) can act as a data converter class. The DCM for 
25 these devices will register itself as a data converter in the system registry, 
so that clients can find them and use them as necessary. 
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passed via the DCM up to the UL In addition, any status changes of the 
device, e.g. on/off are also passed, via the event system to the DCM which 
uses them to update the UL 

5 Service Modules 

Service modules (e.g., service modules 730) are conceptually similar 
to device control modules. They provide an interface to a service which is 
usually provided by software only. In the present embodiment, service 
modules are of two types, system services and application services. A 

10 system service is a well know service that is provided as part of the HAVI 
software architecture. Examples of these types of services are data format 
translators, protocol converters or graphics services. These services have 
well known APIs which are defined as part of the HAVI architecture. 
Application services are objects that have been created for and by other 

15 service objects. These objects provide a well defined API, however that API 
is not public. In the present embodiment, any application or other object 
that wishes to use an application object needs to know its API and calling 
semantics. Although not required, generally, system services will exist for 
the lifetime of the system. Application services will exist for the lifetime of 

20 an application and may be quite short lived. 

System services 

In accordance with the present invention, many of the services 
provided by the AV architecture are provided as service modules, who 
25 register their services in the system registry and can be accessed using 
messaging. Examples of such services are the UI service modules that 



45 



BNSDOCID: <WO 993585€A2_L> 



WO 99/35856 PCT7US98/26166 

provide a mechanism to allow devices to present a UI to the user, data 
format services that convert AV data between different formats. 

THE DCM MAWACTR 
Overview 

In accordance with the present invention, the DCM Manager is 
responsible for all aspects of handling the collection of DCMs resident on a 
FAV node. This includes the tasks of discovering, instantiating and 
disposing of all possible device control module candidates that are available 
to a given system. Device resource management is generally carried out by 
individual DCMs, however, where multiple devices or services are 
interacting and where some of the DCMs are located on different FAV 
nodes, higher level management will be needed. Therefore, the DCM 
15 Manager communicates with other DCM Managers on remote nodes to 
arbitrate for network-wide device and subdevice resource allocation and 
management. Its responsibilities are discussed below. 



10 



20 



25 



Discovery and enumeration nf p hysical devices 

In accordance with the present invention, the DCM Manager works 
with the underlying OS services to obtain a raw list of available devices. 
Note that depending on the underlying bus technology, these DCMs may be 
dynamic. In the present embodiment, for example, as physical devices 
come and go on a 1394 bus the DCMs will come and go with them. In the 
same manner, the service and aggregate device DCMs are also dynamic, 
being created and destroyed in response to events in the FAV node. 
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This task requires interaction both with elements of the AV 
architecture and also with elements of the FAV host OS, node hardware 
and communications hardware. Due to this, the exact process required for 
device discovery will depend on the system environment. However, the 
5 general approach, of querying a device and any SDD data it contains to 
discover its characteristics, as discussed in the DCM section, is common. 
In the present embodiment, this requires the DCM manager to follow a set 
of rules in a given sequence each time the system is initialized, or any time 
the system may change (such as when the bus is reset). 

10 

Creation of Gengrir HHMp 

In accordance with the present invention, for each node, the DCM 
Manager does enough work to determine that it should create a DCM. This 
work is carried out for all media-related devices which will be managed by 

15 the FAV node. In the present embodiment, Devices under a different 

management technology, e.g. USB based devices, may be presented within 
the architecture as DCMs on nodes that support USB communication, or as 
special DCMs that act as proxies for a remote management system. It 
should be noted, however, that some USB-based devices such as hard disks 

20 may in fact be made to appear simply as random-access media recording or 
playback devices; in these cases, they are treated like any other "real" media 
device. In the present embodiment, for each media-related entity, the DCM 
Manager will create a generic or level 1 DCM. Each DCM will later have 
the responsibility to make itself more device-specific if possible. This is 

25 described below. 



Integration of lev*! 2 nr?M* 
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In cases where an over-ride (e.g., level 2) DCM is available and 
accessible, the DCM manager is responsible for attempting to fetch that 
DCM and installing it into the FAV node. In the present embodiment,, the 
details of how the over-ride DCM and the generic DCM interact is 
5 dependent on the DCM developer. For example, in some cases it will 

completely replace the default DCM, in others it will work with the default 
DCM to augment its capabilities. 



In accordance with the present invention, manufacturer-supplied 
10 level 2 DCMs may come from a variety of sources. Devices may cany them 
within their ROM or some other storage mechanism such as the header of 
a disc or tape. They may be downloaded from a web or ftp site if such 
capabilities are accessible to the FAV node, or they could be supplied in the 
typical computer industry manner, via an installation from a disk or other 
15 storage medium. Allowing this manufacturer-supplied over-ride DCM 
capability requires a model for creating and installing DCMs. In the 
present embodiment, when installed, the level two DCM will provide the 
same base interface to the client as a level 1 DCM, while either providing 
additional interfaces or just underlying functionality modifications. 

20 

DCM Dispn^l 

In accordance with the present invention, the DCM Manager will be 
responsible for disposing of DCMs at the appropriate times, and notifying 
clients that DCMs have been removed. In the present embodiment, the 
25 rules for when DCM disposal occur, and the distribution of responsibility 
for clean up, between the DCM and the DCM Manager, are tailorable to for 
the specific requirements of a particular HAVI network. 
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10 



15 



Coordinate Among st Multiple DCMs 

Some complex services among multiple DCMs, for example, 
command queuing of complex operations, etc., require the DCM Manager 
to coordinate with multiple DCMs to carry out these operations. This will 
be influenced by the "command model" that is provided for clients. For 
example; if we define an upper level API that allows clients to specify 
actions that are based on HH:MM:SS:FF time codes, then we need to 
translate between this time model and whatever the hardware or 
underlying support modules deal with. It should be noted that complex 
time-based operations that are affected by mechanical delays, etc., need to 
be accounted for. This type of coordination requires some notion of real 
time behavior in the network and is dependent on the physical and software 
infrastructure providing some level of guarantee. 



Referring now to Figure 8, a layered logic diagram 800 of one HAVI 
architecture in accordance with the present invention is shown. The 
components shown in diagram 800 are similar to those shown in diagram 
700, however, diagram 800 is organized such that high level processes are 
20 on top (e.g., applications 801) with respect to lower level processes on the 

bottom (e.g., 1394 module 830). Diagram 800 also depicts other services 810, 
transportation adaptation modules 815, and other modules 840. 

As described above, the overall HAVI architecture can be shown as 
25 communications components and service components. Applications 801, at 
the highest level in the architecture use the services and the 
communication components (e.g., DCMs 720, service modules 730, etc.). In 
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turn, a number of the service components (e.g., service modules 730, DCMs 
720, etc.) will use the underlying communications components (e.g., 
messaging 702, transportation adaptation modules 815, etc.). For example, 
in the case of one of applications 801 requesting, via the registry 706, the 
5 handle for a DVTR (digital video tape recorder) device, and then sending a 
play command to the device. As described above, components in the HAVI 
architecture communicate using the underlying messaging system, i.e. the 
modules use message passing. 

10 Figure 9 shows a diagram 900 of local and remote messaging in the 

HAVI architecture of one embodiment. The messaging component 702 is 
showu handling both local messaging and remote messaging. Hence the 
messaging component 702 is depicted at the base of diagram 900. Local 
messages are shown as arrows 902a, 903a, 904a, to various applications 901- 

15 904. A remote message is shown as arrow 901b. For the sake of clarity, in 
diagram 900 and in the following discussions, local communication via the 
messaging system is not depicted, rather, local messaging (e.g., arrows 
901a-904a) are shown as if based on direct function calls between 
components. 

20 

Figure 10 shows a diagram 1000 of a message being sent via 1394 in 
the HAVI architecture of one embodiment. In diagram 1000, message 1 
(e.g., arrow 820a) is a request from one of applications 801 to the registry 706 
(via the query API) for the handle of a DVTR device. The registry 706 
25 returns a handle for the DVTR DCM in message 2 (e.g., arrow 820b). This 
handle is the message address used for the messaging system. 
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In accordance with the present invention the application then uses 
the handle to invoke the DCM for the DVTR with message 3 (e.g., 820c). 
The DCM converts the application invocation of the play call to an internal 
com m and which is sent to the messaging component, message 4 (e.g., 
5 arrow 820d). This internal command is part of the well defined command 
set at level 1, i.e. it is a HAVI command. The messaging component 702 
then internally uses the handle information to determine which bus this 
device resides on. When it discovers that it is on the IEEE! 1394 bus, it uses 
the IEEE 1394 transport adaptation module (TAM) 830 to convert the 
10 message to a 1394 packet, message 5 (e.g., arrow 820e), which is placed in 
the data portion of a FCP packet. The TAM then calls the 1394 device 
driver, message 6 (e.g M arrow 820f) to send the message over 1394. 

At the receiving side (not shown), the message will be delivered to the 
15 1394 device driver, and then passed up through a 1394 TAM to the 

Messaging component. The messaging component will receive a HAVI 
message packet which it will then deliver to the receiving code directly via a 
message queue or callback function. In the present embodiment, if the 
receiving device is an LAV device, it will only have the communications 
20 component of the CCEP architecture and the registry. Any other 
functionality it has will be device specific. 

It should be noted that the previous example in Figure 10 illustrates a 
distinction in the HAVI architecture between the messaging system and 
25 the command set used to control devices. In accordance with the present 
invention, the messaging system is a generic messaging mechanism that 
provides a message packet with a data section whose contents are 
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completely opaque to the messaging system. For example, the messaging 
system can cany private application to application commands, AVC-CTS 
commands, CAL commands or any other command. The DCM is the entity 
responsible for communicating with remote devices, it uses the messaging 
5 system to carry commands specific to that device. For a level 1 HAVI 
compliant device, the command set carried by the messaging system is 
defined as part of the CCEP architecture. Messages carried by the 
messaging system between DCMs and devices they control contain these 
well defined commands. For level 2 devices the extended command set is 
10 undefined, these may be pure AV/C-CTS, CAL or any other commands. 

Referring now to Figure 11, a diagram 1100 of an application 
invoking another application in one embodiment of the HAVI architecture 
is shown. Diagram 100 shows an application 801a running on a device 1101 

15 passing a message 1105 to an application 801b running on a separate device 
1102 via messaging systems 702a and 702b. As described above, any 
application running within the HAVI network can access any other 
application if it has a message handle for that application. To acquire a 
message handle, the same process is used as for a remote IAV device (e.g., 

20 described in Figxire 10 above). Once a message handle is available, the 
source application 801a can send a message 1105 to the target application 
801b. As described above, the format of these messages is entirely 
dependent on the application and is of no concern to the CCEP architecture. 
It simply provides a communication mechanism to send a receive 

25 messages between the applications. 
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It should be appreciated that in the above example, it is assumed that 
the applications 801a and 801b reside on different AV devices 1101 and 1102. 
However, as discussed previously, it is quite possible that these applications 
801a and 801b will reside on the same AV device and so the messaging 1 
5 system will perform a purely local communication call rather than a call 
that uses 1394 to transport the message. 

Invoking a software service 

A software service is a special case of the generic application case 

10 above. In accordance with the present invention, a software service is 
simply an application that is part of the system infrastructure. In this 
case, when a module wishes to invoke a system service, e.g. the UI 
component, it uses the messaging component to do this. If the UI 
component is local then the call is contained entirely within one AV device. 

15 However, if the UI component is remote, then the call will be routed over 
the 1394 network to the remote AV device, where the message system will 
dispatch the call to the UI system service. 

Adding a new device to a HA VI network 
20 In adding new devices to a RAVI network, there are 3 general 

situations: handling a legacy device using a legacy protocol carried over a 
non 1394 network; handling a base device using a non HAVI protocol over 
a 1394 network; and handling a new IAV device that is HAVI compliant. 

25 In the case of adding a legacy device, in the present embodiment, a 

legacy device can only be directly controlled by an FAV node. As described 
above, for each legacy device, a legacy DCM must be created. Consider an 
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FAV that has a 1394 port and an Ethernet port. The CMM module will have 
been configured to manage both 1394 and Ethernet. When the legacy device 
becomes know to the FAV, it will first become known at the CMM module. 
Note that the mechanism used to achieve this is not within the scope of the 
5 CCEP architecture. It is communications media specific. Once the CMM 
recognizes a new device, it will go through whatever media specific 
mechanism it uses to determine the type of the device. Again this is not 
part of the CCEP architecture. Eventually it will ask the DM to instantiate a 
legacy DCM for this device. It is assumed that the FAV node has been pre- 
10 configured with this DCM. 

In the present embodiment, once the DCM is created, it registers 
itself in the same way as any standard DCM. However, one crucial 
difference between this DCM and other DCMs is that the communication 

15 model and the command set used to control the legacy device is completely 
unknown to the CCEP architecture. For example, it is possible that the 
device is an IP device that implements a printer service. In this case the 
DCM will provide a set of commands such as Print, Status etc. When an 
application calls the DCM API with a print request, the print command 

20 will be sent out by the DCM, via an IP stack, to the printer device. The 
actual details of how this happens are implementation specific. 

In accordance with the present invention, one possibility is that the 
legacy DCM has a full implementation of the IP stack within the DCM and 
25 knows how to bind to the Ethernet device driver. Another possibility is that 
the FAV device provides an IP stack and a higher level API such as 
sockets. These are FAV implementation details and not part of the CCEP 
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architecture. However, it should be noted that the legacy DCM is acting as 
a "proxy" DCM. Once it has been registered in the registry, it is visible to all 
other modules in the home network. They can all invoke its API and it 
performs the necessary conversion to the private command language of the 
5 Ethernet IP printer. 



In the case of adding a base AV device, in the present embodiment, 
when the CMM is informed about the new device, its recognizes that this is 
not a CCEP node, but it also discovers that a DCM is available for this 
device. In this case, the CMM is responsible for implementing a 
mechanism that allows it to upload the DCM and to ask the DM to create 
this DCM. However, once the DCM is instantiated then it uses a purely 
private communication mechanism to access and control the device. As 
described above, in the present embodiment, a base AV device is one that 
uses 1394 and implements the over-ride DCM but does not implement any of 
the CCEP architecture and will not implement level 1 HA VI commands. 
An example of this device could be one that contains an over-ride DCM but 
does not support the CCEP communications infrastructure. 

In the case of adding an IAV device, it should be appreciated that in 
the previous examples, the application queried the registry to get a message 
handle for the device it wished to communicate with. Note that for a FAV 
device, the handle returned is always used to access the DCM. It is not 
possible to send messages directly to the device. To understand how a 
device which is added to the network becomes available via the registry then 
the following example is used. 
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For example, assume a new device (e.g., a camcorder) is plugged 
into the HAVI network (e.g., 1394 based). This causes a bus reset. The bus 
reset is handled by the Communications media manager (CMM) on the 
IRD. The CMM is responsible for querying the SDD data of the Camcorder 
device to discover its capabilities. Assuming the device is a level 1 device, 
i.e. it does not have an uploadable DCM, then the CMM informs that Device 
Manager, that a new device has been installed. The Device Manager 
creates a new DCM for this type of device and registers the DCM with the 
registry. The DCM, when it initializes is free to query the device directly to 
find out more information about itself and to specialize itself if needed, e.g. 
it can access UI information if it exists in the device. Once the DCM is 
registered in the registry, then any other module can query the registry to 
get a handle for the device and communicate with the DCM to access and 
control the device and present the UI to the user. 



15 



For example, Figure 12A and 12 B show an exemplary UI display 
(e.g., on a television screen) for such a device(e.g., the camcorder). Figure 
12A shows a text menu display, where the user is presented with the 
various controls that can be modified using the control names and control 

20 values. For buttons, the user can select them (which equates to pushing a 
button). Figure 12B shows a "next level" UI display for the camcorder. 
Here, the user selected the main panel from the menu in Figure 12A, and 
the display presents controls based on their grouping information. In the 
present embodiment, group names are used on a tabbed interface to allow 

25 the user to navigate between groups within the selected panel. 
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Referring now to Figure 13, a flow chart of a process 1300 in 
accordance with one embodiment of the present invention is shown. 
Process 1300 shows the steps of a method for providing seamless 
interoperability and integration of a plurality of devices in a HAVI network 
5 by using the SDD information stored in each device. Process 1300 begins in 
step 1301, where a new device is coupled to a HAVI network. In step 1302, 
the device is queried to obtain a description (e.g., SDD) of level 1 functions 
supported by the device. In step, 1303, a level 1 DCM, which implements 
the level 1 functions, is generated for the device based upon the SDD. In 
10 step 1304, the device manager determines whether the new device contains 
software for a level 2 DCM. 

Referring still to Figure 13, in step 1305, if the new device contains 
software for implementing level 2 functions, the software is retrieved from 

15 the device and in step 1306, a level 2 DCM which implements the level 2 
functions is generated using the software. In steps 1307 and 1308, the 
device is continually accessed via the level 2 DCM. In steps 1309 and 1310, if 
the new device does not include software for a level 2 DCM, the new device 
is continually , accessed via the level 1 DCM. In this manner, the 

20 combination of the level 1 DCM and the level 2 DCM allow the present 

invention to provide seamless interoperability and integration of the new 
device with the plurality of devices in the network. 

Figure 14 shows a flow chart of a process 1400 in accordance with one 
25 embodiment of the present invention. Process 1400 shows the steps of a 
method for providing a basic command functionality and an expanded 
command functionality between a plurality of devices in a HAVI network. 
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In step 1401, a device is coupled to a HAVI network which includes a FAV 
device. In step 1402, a generic level 1 DCM for the device is generated by the 
FAV device. As described above, the generic level 1 DCM is a basic 
abstraction of the capabilities of the device. The generic level 1 DCM 
5 enables the device to respond to a basic set of commands from the FAV 
device. In steps 1403 and 1404, the FAV device uses the generic DCM to 
query the device to determine whether the device includes descriptive 
information (e.g., SDD). As described above, the descriptive information 
describes the capabilities of the device. In step 1405, if the device includes 

10 descriptive information, the FAV device generates a parameterized DCM 
for the device by modifying the generic DCM based upon the descriptive 
information. In steps 1406 and 1407, the device is continually controlled 
using the parameterized level 1 DCM. In steps 1408 and 1409, if the device 
does not include descriptive information, the FAV device is continually 

15 controlled via the generic level 1 DCM. 

Referring now to Figure 15, a flow chart of a process 1500 in 
accordance with one embodiment of the present invention is shown. 
Process 1500 shows the steps of a method for ensuring future upgradability 

20 and expandability of devices in HAVI network. In step 1501, a default level 
1DCM for a device coupled to the network is generated. As described above, 
the default level 1 DCM is configured to ensure at least a minimum degree 
of interoperability between the device and the other devices on the HAVI 
network. In step 1502, the device is accessed by other devices via the default 

25 level 1 DCM. As described above, the default DCM enables the first device to 
respond to a default set of commands from other devices on the HAVI 
network In step 1503, an updated level 1 DCM for the devices is either 
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received or not received. In step 1504, updated level 2 DCM for the device is 
either received or not received. As described above, the updates enable the 
device's capabilities and functionality to evolve (e.g., as new, more efficient 
software becomes available). 

5 

In steps 1509 and 1508, where an updated level 1 DCM is received, the 
updated level 1 DCM is incorporated (e.g., this could involve merely 
modifying the current level 1 DCM) and the device is continually accessed 
via this DCM until a later update is available. In step 1505, where an 

10 updated level 2 DCM is received, the DCM manager on the host FAV device 
u nlinks the current DCM, and in steps 1506 and 1507, the updated level 2 
DCM is linked and the registry is updated to allow other devices within the 
HAVI network to access the updated level 2 DCM. This DCM is continually 
used for accessing the device until a later updated level 2 DCM is received. 

15 In step 1510, if neither an updated level 1 or an updated level 2 DCM is 

received, process 1500 continues operation with the current DCM (e.g., the 
last installed DCM). 

Figure 16 shows a flow chart of a process 1600 in accordance with one 
20 embodiment of the present invention. Process 1600 shows the steps of a 
method for providing seamless interoperability and integration of legacy 
devices with the HAVI compliant devices in a HAVI network. Process 1600 
begins in step 1601, where a legacy device is coupled to the HAVI network. 
In step 1602, the legacy device is queried via the proprietary protocol to 
25 determine a set of basic capabilities of the legacy device. As described 

above, HAVI compliant devices use a common HAVI defined protocol. The 
legacy device typically communicates with external devices (if at all) using 
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a proprietary protocol. In step 1603, process 1600 maps a set of basic 
commands from the common protocol to the set of basic capabilities of the 
legacy device. In step 1604, a level 1 DCM for the legacy device is generated. 
As described above, the DCM is based upon the set of basic commands. In 
5 steps 1605 and 1606, the legacy device is continually accessed via the level 1 
DCM such that the other HAVI devices are able to access the set of basic 
capabilities of the legacy device. * 

Figure 17A shows a flow chart of a process 1700 in accordance with 
one embodiment of the present invention. Process 1700 shows the steps of a 
method of controlling devices within a home audio/video network using an 
application program from an external service provider. In step 1702, an 
application program is originated by a service provider (e.g., via cable 
television, internet web site, etc.). In step 1703, the service provider 
communicates the application program from the service provider to an 
intelligent receiver/decoder device of the HAVI network over a logical 
channel. The application is subsequently instantiated within a computer 
readable memory unit of the intelligent receiver/decoder. 

Referring still to Figure 17A, in step 1704, the application program 
queries the HAVI registry of the device (e.g., FAV device) to locate DCMs on 
the network and selects a respective DCM from the registry. In step 1705, 
the down loaded application determines a communications point 
information from the selected DCM. In step 1706, the application controls a 
25 respective device of the HAVI network by communicating with the 

respective device using the communication point information. In step 1707, 
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if the application needs to control another device, steps 1704 through 1706 
are repeated. If the application does not need to control another device, 
processes 1700 ends in step 1708. 



5 Figure 17B shows a diagram of a HAVT network 1750 with the service 

provider 1720 in accordance with process 1700 of Figure 17A. As described 
above, the application program is downloaded from the service provider 
1720 to the HAVI network 1750. The application is instantiated on the 
processor 601 and memory 602 of the intelligent device (e.g., set top box 301). 
10 HAVI network 1750 also includes four HAVI devices, device 0 through 
device 3 (e.g., television, DVTR, etc.). 

PCM MANAOTr f iwn?.Krr apt 

An example DCM management API in accordance with one 
15 embodiment of the present invention is shown below. In the present 
embodiment, the common DCM commands include areas such as 
connection management, information and status queries for the device and 
its plugs etc. Regardless of the type of device represented by the DCM, such 
message sets need to be supported. 

20 

The following is a list of DCM management messages that, in the 
present embodiment, all DCM's need to support for the HAVI architecture: 

ChannelUsage(plug); // returns the 1394 isoch. channel used by the 
25 specified unit plug 

PlugUsage(channel); // returns the plug associated with the specified 
channel 
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GetDevicePlugCount(count); // returns the number of unit plugs on the 
device & 

EstablishlnternalConnection(sourcePlug, destPlug); 
5 * 

EstablishExternalConnection(sourcePlug, destPlug) 
StartDataFlow(plug); 
10 StopDataFlow(plug); 

GetSourceConnection(in dest, out source); // given a destination plug 
return the source to which it is connected (return the source plug of the 
transmitting device which shares the same isoch. channel) 

15 

GetDestinationConnection(in source, out ); 
GetAllConnectionO; 
20 NotifyOnConnectionChangeQ; 

GetDynamicConnectionCapabiUtyO; // report whether the target device 
supports dynamic connection changes or not (e.g., a non-1394 device) 

25 LockConnection(plug); 
UnlockConnection(plug); 

GetConnectionStatus(plug); // status = busy, data transmission format, 
ou channel, bandwidth usage, etc. 

BreaklntemalConnection(plug); 
BreakExternalConnection(plug); 

35 

GetlnputSignalFormat(plug); 

setlnputSignalForrnat(plug); 

40 NotifylnputSignalFormat(plug); // send a notification if the signal format 
changed. 

2^^PP orted lnputSignaIFormats(plug); // repeat the above for output 

45 

Getf;unctionInfo(); // return information about the functional modules 
within the device (e.g., the AV/C subunits) 

GetDeviceTypeO; 
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GetVendorNameO; 
GetVendorLogoO; 

5 

SetDevicePowerState(powerstate); 
GetDevicePowerState(powerstate); 
10 GetSupportedPowerStates(list); 
NotiyPowerState(powerstate); 
ReserveDeviceO; 

15 

GetDeviceReservationStatusO; 

NotifyDeviceReservationStatusO; 

20 VendorDependentCommandCccmmand parameters); // pass thru a 
vendor-specific command in the native protocol; 

Function Control Module (FCM) Messages; 

25 The function-specific messages correspond to the typical native 

commands such as PLAY, STOP, REWIND for the VCR functionality 
within a device. Because we need to address these messages to a well 
defined location within a device, we use the FCM (Function Control 
Module) to represent the target of these messages. Like DOM's, there are 

30 some messages that have to deal with administration and management of 
FCM's. These messages are supported by all FCM's, independent of their 
particular domain. The messages are as follows: 

GetFunctionTypeO; II VCR, tuner, disc, etc. 

35 

GetFunctionlnfoO; // more detailed information about the function, such as 
the particular kind of disc player (DVD, CD, etc.) 

GetNumberOfPlugs(inputPlugs outputPlugs); // returns the number of 
40 source and destination plugs for the functional module 
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GetFunctionStatusO; // current status of the functional module, including 

the status of source and destination plugs (input and 

output) 

5 GetPowerState(powerState); // functional modules may have individually 
controllable power states 

SetPowerState(powerState); 

10 GetSupportedPowerStates(list); 

GetSupportedDataFormats(list); // returns the data formats supported by 
this functional module 

15 NativeCommand(params); // send the functional module a command in its 
native command protocol 

The functional domain messages are based on the type of function (VCR, 
tuner, etc.). These are the typical PLAY, STOP, REWIND commands that 
20 one would expect. 

Level I interoperability includes both device-to-device and human-to- 
device interaction. The functional message sets such as PLAY, STOP and 
REWIND are used for device-to-device interaction. One example of this 
25 would be a video editing software package that wants to control any type of 
VCR; the program is designed with a very specific set of user interface 
controls which apply to all VCR's. When the user interacts with the 
application, the application in turn sends domain-specific commands such 
as PLAY and STOP to the target device. 

30 

In the HAVI architecture, the application will send these messages 
to the DCM, and the DCM will translate them into the native language of 
the target BAV device. If the target device happens to support the HAVI 
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messaging architecture, then these commands don't need to be translated 
at all; they are simply sent as HAVT message to the HAVI target. 



Camcorder devices are essentially VCR like. Their additional 
5 functionality is part of the camcorder effects, transitions, etc. They are as 
follows: 



stopO 
play() 
10 rewindO 
forwardO 
recordO 

volume(setvalue) 

changeStatus(newMode) // newMpde of: VTR, CAMERA, STANDBY 
15 cameraControl(controlType) // controITYPE defines control Type and 
subType structures eg zoom, zoom Value, or Effect, transitions etc. 



MiniDiscs are of the category random access storage, they support a 
base set of commands to control PLAY, FORWARD, etc and a set of 
20 command specific to random access media. The commands are as follows: 



stopO 
playO 
rewindO 
25 forwardO 
recordO 

volume(setValue) 

changeStatus(newMode) // newMode of: STANDBY 
seek(track) 
30 seekstartO 
seekEndO 
getDisklnfoO 

mdControl(controlType) // controITYPE defines control Type and subType 
structures eg intro mode, random play. 

35 
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Hard Disks are of the category random access storage, they support a 
base set of commands to control PLAY, FORWARD, etc and a set of 
command specific to random access media. The commands are as follows: 

5 stop() 
playO 
rewindO 
forwardO 

record(type) // type structure passes info to allow intelligent devices to 
10 optimise storage policy changestatus(newMode) // newMode of STANDBY 
seek(track) 
sdek(block) 
seekStartO 
seekEndO 

15 HDDControl(controlType) // controlTYPE defines control Type and subType 
structures eg layout commands for block-structures 



With respect to user interfaces, it should be appreciated that a 
generic and simple UI may be a textual based one, as shown in Figure 12A. 
20 A more sophisticated one, based on DCM specialization, may be as shown 
on figure 12B. Where graphical information, carried in SDD is used by the 
generic DCM to specialize itself. 

Hence, the present invention provides a home audio visual (AV) 
25 network which defines an open architecture for inter-operating CE 

(consumer electronic) devices in a home network. The interoperability 
aspects of the present invention define an architectural model that allows 
CE devices from any manufacturer to inter-operate and function 
seamlessly within the user's home AV system. The system of the present 
30 invention includes a combination of a base set of generic device controls 
with an method to extend a base control protocol as new features and new 
CE devices are deployed within the home AV network. In so doing, the 
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architecture of the present invention is extensible, and can be readily 
modified and advanced as market requirements and technology change. 



The foregoing descriptions of specific embodiments of the present 
invention have been presented for purposes of illustration and description. 
They are not intended to be exhaustive or to limit the invention to the precise 
forms disclosed, and obviously many modifications and variations are 
possible in light of the above teaching. The embodiments were chosen and 
described in order to best explain the principles of the invention and its 
practical application, to thereby enable others skilled in the art to best 
utilize the invention and various embodiments with various modifications 
as are suited to the particular use contemplated. It is intended that the 
scope of the invention be defined by the Claims appended hereto and their 
equivalents. 
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CLAIMS 

What is claimed is: 

1. A method for providing interoperability and 
communication between a plurality of devices in a network 
using a common protocol, the method comprising the steps of; 

a) coupling a legacy device to the network as one of 
the plurality of devices wherein the legacy device 
communicates with the network using a proprietary protocol; 

b) querying the legacy device using the proprietary 
protocol to determine a set of basic capabilities of the 
legacy device; 

c) mapping a set of basic commands from the common 
15 protocol to the set of basic capabilities of the legacy 

device ; 

d) generating a control module for the legacy device, 
wherein the control module is based upon the set of basic 
commands ; and 

20 e) accessing the set of basic capabilities of the 

legacy device to provide interoperability and communication 
between the legacy device and the plurality of devices by 
accessing the legacy device via the control module. 



25 



2. The method of Claim 1 wherein steps b) through d) 
are performed by a device manager executing on an 
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intelligent device of the plurality of devices in 
the network. 

3 . The method of Claim 1 wherein the control module 
provides a standardized control interface for the legacy 
device . 

4 . The method of Claim 3 wherein the standardized 
control interface includes software code which provides a 
predefined set of interoperability interfaces for the legacy 
device which enable communication between the legacy device 
and the plurality of devices in the network. 

5 . A method for a home audio visual network including 
a plurality of devices coupled to a bus, wherein one device 
is a host device having a processor coupled to a computer 
readable memory, the memory containing computer readable 
instructions which when executed implement a method for 
providing interoperability and communication between the 
devices, the method comprising the steps of: 

a) querying a legacy device, of the plurality of 
devices, via a proprietary protocol of the legacy device to 
determine a set of basic capabilities supported by the 
legacy device; 

b) mapping a set of basic commands from a common 
protocol to the set of basic capabilities of the legacy 
device ; 
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c) generating a control module for the legacy device, 
wherein the control module is based upon the set of basic 
commands ; and 

d) providing interoperability and communication 

5 between the legacy device with the plurality of devices by 
the plurality of devices accessing the set of basic 
capabilities of the legacy device using the control module. 

6. The method of Claim 5 wherein steps a) through c) 
10 of the method are performed by a device manager executing on 

the host device. 

7. The method of ciaim 1 or 5 wherein the control 
module executes on one of the plurality of devices in the 

15 network, 

8 . The method of Claim 1 or 5 wherein the legacy 
device is an analog device. 



20 



25 



9. The method of claim 5 wherein steps a) through 
c) are performed by a device manager executing on the host 
device . 



1C. The method of Claim 1, 6 or 9 wherein the legacy 
device is accessed by the plurality of devices via the 
control module, wherein the plurality of devices communicate 
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with the control module using the common protocol and the 
legacy device communicates with the control module using the 
proprietary protocol. 

11. The method of Claim 1, 5 or 9 wherein step b) 
includes the step of communicating with the legacy device 
using the proprietary protocol to determine the set of basic 
capabilities. 

12. The home audio visual network of Claim l, 5 or 9 
wherein the bus of the network is an IEEE 13 94 bus and the 
control module is configured to function with or to IEEE 
13 94. 

13 . The method of Claim 9 wherein the control module 
provides a standardized control interface for the legacy 
device and wherein the £ control interface includes software 
which provides a predefined set of interoperability 
interfaces for the legacy device which enable communication 
between the legacy device and the plurality of devices in 
the network. 



14 . The method of Claim 5 or 9 wherein the control 
module provides a standardized control interface for the 
legacy device and wherein the control interface includes 
software which provides a predefined set of functionality 
interfaces for the. legacy device which enable communication 
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between the legacy device and the plurality of devices in 
the network. 

15. A method for an apparatus method for providing 
5 interoperability and communication between a plurality of 
devices in a network using a common protocol, the method 
comprising the steps of: 

a) means for coupling a legacy device to the network 
as one of the plurality of devices wherein the legacy device 

10 communicates with the network using a proprietary protocol; 

b) means for querying the legacy device using the 
proprietary protocol to determine a set of basic 
capabilities of the legacy device; 

c) means for mapping a set of basic commands from the 
15 common protocol to the set of basic capabilities ot the 

legacy device; 

d) means for generating a control module for the 
legacy device, wherein the control module is based upon the 
set of basic commands; and 

20 e) means for accessing the set of basic capabilities 

of the legacy device to provide interoperability and 
communication between the legacy device and the plurality of 
devices by accessing the legacy device via the control 
module . 



72 

SUBSTITUTE SHEET ( rule 26 ) 

3NSDOC1D: <WO 9935856A2J_> 



harass 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 



PGT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 : 
H04L 12/28, 29/06 



A3 



(11) International Publication Number: 
(43) International Publication Date: 



WO 99/35856 

15 July 1999 (15.07.99) 



(21) International Application Number: PCT/US98/26166 

(22) International Filing Date: 9 December 1998 (09.12.98) 



(30) Priority Data: 

09/003,252 



6 January 1998 (06.01.98) 



US 



(71) Applicant: SONY ELECTRONICS, INC. [US/US]; 1 Sony 

Drive, Park Ridge, NJ 07656 (US). 

(72) Inventor: LEA. Rodger, J.; 210 & 1/2 16th Street, San Jose, 

CA 95113 (US). 

(74) Agents: GALLENSON, Mavis, S. et aL; Ladas & Parry, 
Suite 2100, 5670 Wilshire Boulevard, Los Angeles, CA 
90036-5679 (US). 



(81) Designated States: AL, AM, AT, AU, AZ ? BA, BB, BG, BR, 
BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES, FI, GB, GD. 
GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, KG. KP, 
KR, KZ, LC. LK, LR, LS, LT, LU, LV, MD, MG, MK, 
MN, MW, MX, NO. N2. PL, PT, RO. RU, SD, SE, SG, 
SI, SK, SL, TJ, TM, TR, TT, UA, UG. UZ, VN, YU, ZW, 
ARIPO patent (GH, GM, KE, LS, MW, SD, SZ, UG, ZW), 
Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ. TM), 
European patent (AT, BE, CH, CY, DE, DK, ES, FI. FR, 
GB, GR, IE, IT, LU. MC, NL, PT, SE), OAPI patent (BF, 
BJ, CF, CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, 
TD, TG). 



Published 

With international search report. 

Be/ore the expiration of the time limit for amending the claims 
and to be republished in the event of the receipt of amendments. 

(88) Date of publication of the international search report: 

26 August 1999 (26.08.99) 



(54) Title: AN AUDIO VIDEO NETWORK 

(57) Abstract 

A method and system for providing seamless 
interoperability and integration between a plurality 
of devices in a network using a common protocol, 
wherein at least one of the devices is a legacy device 
which communicates with the network using a 
proprietary protocol. When a legacy device is 
coupled to the network, one of the plurality of 
devices on the network queries the legacy device via 
the proprietary protocol to determine a set of basic 
capabilities supported by the legacy device. The set 
of basic capabilities are then mapped from the 
proprietary protocol to a set of basic commands 
from the common protocol. A control module is 
generated for the legacy device, wherein the control 
module is based upon the set of basic commands. 
The set of basic capabilities of the legacy device are 
then accessed via the control module, thereby 
providing seamless interoperability and integration 
of the legacy device with the plurality of devices. 



Add a Legacy Device to a 
HA VI Network 



Query.the Legacy Device to 
Determine a Set of Basic 
Capabilities 



Map a Set of Basic 
Commands to the Set of 
Basic Capabilities of the 
Legacy Device 



Generate a Level 1 DCM for 
the Legacy Device Based 
Upon the Set of Basic 
Commands 



-1601 



-1602 



-1603 



-1604 



Access the Legacy Device 
via the Level 1 DCM 



-1605 



Continue 



-1606 



BNSDOCID: <WO 99358 56A3J_> 



WO 99/35856 



1 / 17 



PCTAJS98/26166 




SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 99358 56A2_I_> 



WO" 99/35856 

10b 



2 / 17 



PCT/US98/26166 




BNSDOCID: <WO. 



.993S8S6A2_L> 



FIG. 1B 

SUBSTITUTE SHEET ( rule 26 ) 



W099/35856 



3/17 



PCT/US98/26166 




300 




FIG. 3 



9935856A2_I_> 



SUBSTITUTE SHEET ( rule 26 ) 



WO 99/35856 4 / 17 PCT/US98/26166 



400 

_\_ 




FIG. 4 



500 




FIG. 5 



SUBSTITUTE SHEET ( ruie 26 ) 

BNSDOCID: <WO 99358 56A2_I_> 



WO 99/35856 



5 / 17 



PCT/US98/26166 




WO 99/35856 



6 / 17 



PCT/US98/26166 










o 

CO 








SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 9935B56A2J_> 



WO 99/35856 



7 / 17 



PCT/US98/26166 




SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 9935856A2_I_> 



WO?9/35856 



8 / 17 



PCT/US98/26166 




SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 99358 56A2_I_> 



WO 99/35856 



9 / 17 



PCT/US98/26166 




SUBSTITUTE SHEET ( rule 26 ) 



WO 99/3S856 



10 / 17 



PCT/US98/26I66 




702b 



1105 



FIG. 11 

SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 9935856A2_L> 



WO 99/35856 



11 / 17 



PCT/US98/26166 



Sony Model XYZ 5000 Digital VCR 
Main Panel 

Play Select 

Stop Select 

, fast Fofward ^ ._. ^ ^_ ._. ^ ._Select_ 
iJRewind ^ ^ ^ ^..Select ] 



To Main Menu To Editing Panel 

^ — ■ y 



FIG. 12A 



f LCD Panel ^ ( Device Control 



XYZ 5000 Digital VCR 



Play 




Stop 




Rew 




FF 



J 



Main Menu 



Editing Panel 



FIG. 12B 

SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 9935856A2_I_> 



WO 99/35856 

12QQ 



12 / 17 



PCT/US98/26166 



Couple a New Device to a HAVI 
Network 



-1301 



Query the New Device to Obtain 

a Description of Functions 
Supported by the New Device 



■1302 



Generate a Level 1 DCM for 
the New Device Based on 
the Description 



Determine Whether the New 
Device includes Software Code 
for a Level 2 DCM 



■1303 



-1304 



No 



Yes 



Retrieve the Software Code for 
the Level 2 DCM 



■1305 



Generate a Level 2 DCM for 
the New Device Using the 
Software Code 



■1306 



Control the New Device Via the 
Level 2 DCM 



■1307 



Control the New 
Device Via the 
Level 1 DCM 



Continue 



•1308 



1309 



Continue 



•1310 



FIG. 13 



BNSDOCID: <WO. 



SUBSTITUTE SHEET ( rule 26 ) 

.99358 56A2_I_> 



WO 99/35856 



13 / 17 



PCT/US98/26166 



Couple a Device to a HAVI 
Network 






Generate a G< 
DCM for tl 


eneric Level 1 
he Device 



1401 



1402 



Query the Device to Determine 
Whether the Device Includes 
Descriptive Information 



1403 



Descriptive Information 
Included? 



-1404 



1 


Yes 


Generate a Parameterized and 
Specialized DCM by Modifying 
the Generic Level 1 DCM 






► 


Control the De 
Parameter 


vice Using the 
ized DCM 



^1405 



•1406 



Continue 



y 



1407 



No 



Control the Device 
Using the Generic 
Level 1 DCM 



— 1408 



Continue 



•1409 



FIG. 14 



SUBSTITUTE SHEET ( rule 26 ) 

99358 56A2_I_> 



WO 99/35856 
15QQ. 



14 / 17 



PCT7US98/26166 



Yes 



Incorporate 
the Updated 
Level 1 
DCM 



1509 



Generate a Default Level 1 
DCM for a Device 



1501 



Access the Device via the 
Default Level 1 DCM 



■1502 



'Receive an Updated LeveiNT" 
1 DCM for the Device? / 



1503 



No 



Receive an Updated Level 
2 DCM for the Device? , 



-1504 



No 



Continue Accessing 
the Device Using the 
Current DCM 



Continue 



-1508 



? 




Yes 

r ^1505 


-1510 


Unlink the 
Current DCM 








r ^1506 




Link the 
Updated 
Level 2 DCM 








, ^1507 




Update the 
Registry 





FIG. 15 

SUBSTITUTE SHEET ( ruie 26 ) 

BNSDOCID: <WO 9935656A2_L> 



W099/3S8S6 15/17 PCT/US98/26166 

1600 



Add a Legacy Device to a 
HAVI Network 



Query .the Legacy Device to 
Determine a Set of Basic 
Capabilities 



Map a Set of Basic 
Commands to the Set of 
Basic Capabilities of the 
Legacy Device 



Generate a Level 1 DCM for 
the Legacy Device Based 
Upon the Set of Basic 
Commands 



Access the Legacy Device 
via the Level 1 DCM 



C 



•1601 



1602 



•1603 



1604 



•1605 



Continue 



•1606 



BNSDOCID: <WO 99358S6A2J_> 



FIG. 16 

SUBSTITUTE SHEET ( rule 26 ) 



WO 99/35856 
1700 



16 / 17 



PCT/US98/26166 



Start 



1701 



Application Program Originated by Service Provider 
(e.g.. Cable TV, Internet Web Site) 



1702 



Service Provider Communicates Application Program 
Over a Logical Channel (e.g., Cable TV, Internet) to 
Intelligent Device of Home Audio/Video Network 



-1703 



Downloaded Application Program Queries Registry 
of Intelligent Device to Locate DCMS Available 
on the Network and Selects a Respective DCM 
From the Registry 



-1704 



Downloaded Application Program Determines 
Communication Point Information From the 
Respective DCM Selected 



•1705 



Downloaded Application Program Controls a 
Respective Device of the Network by Communicating 
With the Respective Device Using the 
Communication Point Information 



-1706 




1708 



FIG. 17A 

SUBSTITUTE SHEET ( ruie 26 ) 

BNSDOCID: <WO 99358 56A2J_> 



WO 99/35856 



17 / 17 



PCT/US98/26166 



Service Provider (e.g., 
Internet Web Site, Cable TV 



Application Program Downloaded 




Home Audio/Video Network 







1730 



Intelligent Device 
(e.g., Set-Top-Box, Digital TV) 



Processor 
601 



Memory 



DCM 
Registry 

DCMO 
DCM1 
DCM2 
DCM3 

ZQfi 



602 



201 



1750 



FIG. 17B 



SUBSTITUTE SHEET ( rule 26 ) 



BNSDOCID: <WO 9935856A2_I_> 



INTERNATIONAL SEARCH REPORT 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 6 H04L12/28 H04L29/06 



According to International Patent Classification (IPC) or to both national classification and IPC 



Inti tionaf Application No 

PCT/US 98/26166 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 6 H04L H04N H04B 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consutted during the international search (name of data base and. where practical, search terms used) 



C. OOCUMENTS CONSIDERED TO BE RELEVANT 



Category J Citation ot document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



CHILD J: "INTELLIGENT HOME TECHNOLOGY 
LOOKS FOR LEVERAGE FROM RELATED MARKETS" 
COMPUTER DESIGN, 

vol. 36, no. 12, 1 December 1997, pages 
85-87, XP000754856 

see page 87, middle column, line 30 - 
right-hand column, line 34 

EVANS G: "CEBus. Defining the future of 
residential communications" 
AUSTRALIAN ELECTRONICS ENGINEERING, MARCH 
1997. REED BUSINESS PUBLISHING, AUSTRALIA, 
vol. 30, no. 3. pages 34-36. 38. 
XP002105591 
ISSN 0004-9042 
see page 36. left-hand 
middle column, line 7 
see page 38, left-hand 



1,5,15 



1,5,15 



10 - 



column, line 
column, 1 ine 4-10 
-/-- 



Further documents are listed in the continuation of box C. 



|X I Patent family members are listed rn annex. 



4 Speciat^categories of cited documents : 

"A" document defining the general state of the art which is not 
considered to be of particular relevance 

"E" earlier document but published on or after the international 
filing date 

"L" document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

"P* document published prior to the international filing date but 
later than the priority date claimed 



later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

document of particular relevance; the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date ot the actual completion of the international search 

11 June 1999 


Date of mailing of the international search report 

08/07/1999 


Name and mailing address ot the ISA 

European Patent Off ice, P. B. 5818 Patentlaan 2 
NL - 2280 HV Rijswifk 
Tel. (+31-70) 340-2040. Tx. 31 651 epo nl, 
Fax: (+31-70)340-3016 


Authorized officer 

Dupuis, H 



BNSDOCID: <WO_ 



_993585€A3_I_> 



page 1 of 2 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


ci 


Cote d'lvoire 


KP 


. Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






CU 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






CZ 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






OK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







3NSDOCID: <WO 9935856A3_L> 



INTERNATIONAL SEARCH REPORT 



C(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Intt .ional Appu ca tjon No 

PCT/US 98/26166 



Category ' Citation ot document, with indication. where appropriate, of the relevant passages 



EP 0 467 587 A (TOKYO SHIBAURA ELECTRIC 

CO) 22 January 1992 

see column 1, line 11-42 

see column 2, line 55 - column 5, line 5 



Relevant to aatm No. 



1,5,15 



Form PCT/ISA/210 (continuation ot second sheet) (July 1992) 



BNSDOCID: <WO 99358 56A3_I_> 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 



Infon 


nation on patent family members 


Int UonaJ Application No 

PCT/US 98/26166 


Patent document 
cited in search report 


Publication 
date 


Patent family 
members) 


Publication 
date 



EP 0467587 



22-01-1992 



JP 
JP 
JP 
KR 

US 



4077195 A 
2662614 B 
4273795 A 
121329 B 
5473317 A 



11-03-1992 
15-10-1997 
29-09-1992 
20-11-1997 
05-12-1995 



Foim PCT/ISA/210 (patent family annex) (July 1992) 
BNSDOCID; <WO 9935856A3_I_> 



